3-D IMAGING SYSTEM 



CLAIM TO PRIORITY 
This applications claims priority to United States Provisional Application Serial 
5 No. 60/320,076 filed on April 1, 2003, and United States Provisional Patent Application 
No. 60/545,158 filed February 17, 2004. 

STATEMENT OF GOVERNMENT INTEREST 
The work that led to this invention has been supported in part by a grant fi:om the 
10 Office of Naval Research, Grant Number N00014-01-1-0279. Thus, the United States 
Government may have certain rights to this invention. 

FIELD OF THE INVENTION 
This invention relates to the field of imaging techniques and the in situ evaluation 
15 of the properties of surfaces or features of interest. More particularly, the instant 
invention relates to a system for inspecting the surface characteristics of a vessel or the 
ocean floor using a tethered or autonomous vessel designed to accurately image the 
surface under inspection to locate abnormalities or features of interest. 

20 BACKGROUND OF THE INVENTION 

Interest in the profile of underwater surfaces has grown significantly in the past 
several decades. Indeed, the ability to map and detect features in the underwater 
environment have become of interest in the areas of science, resource exploration, and 
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national defense, to name a few. This has led to the development of various types of 
instrumentation for imaging the areas of interest. 

One type of imaging system employs the use of sonar technology and translates 
the differences in the echo signal to locate abnormalities in a body of water. U. S. Patent 
5 No. 5,321,667 to Audi et al represents such a system. These systems are adapted to 
generate information over a large scan area, but are limited in degrees of resolution, 
which dictates accuracy of the information, based on the ping rates and distance to the 
object. 

A multi-platform system for acoustic surveillance is disclosed in Gaer, U.S. 

10 Patent No. 5,231,609. In Gaer, a plurality of acoustic platforms aid in providing an 
accurate sonic image or shadow. Because of the use of more than one signal to produce 
the image, Gaer is able to track a moving object. This system, however, requires a highly 
sophisticated interfacing of the actual signals and signal generators to provide the sought 
information, thus making it a very expensive system and one that, by virtue of the amount 

15 of variables to be controlled, may be difficuh to keep in synchronization. 

Another system, which employs a plurality of platforms, is disclosed in Schmidt 
et al, U.S. Patent No. 5,894,450. This multi-AUV system is able to obtain a profile of 
data by virtue of collecting the single data sets obtained by the AUV's and collating the 
same. This again may be a highly expensive and complicated system to use. 

20 Another imaging system is described in Haley et al, U.S. Patent No. 5,155,706. 

In Haley et al. the data obtained firom different passes over the image are manipulated 
according to an algorithm to produce a clearer image of the desired object or feature. 
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This system, although being lower in cost and easier to use than the multi-platform 
systems, admittedly produces notable false readings. 

An additional patent to Haley et al, U.S. Patent No. 5,612,928, also describes a 
pixel classifying system, but again this system is incapable of producing 3-D images of 
5 photo quality, but instead resemble computer renderings. 

Jaffe et al, U.S. Patent No. 4,855,961, describes another sonar imaging system 
employing a plurality of transmitters in conjunction with a plurality of receivers to assist 
in establishing a 3-D image of the object. This system, since again it uses sonar for 
imaging, is limited in the degree of resolution available. 
10 Another method of determining the size of an object by virtue of measurements at 

known spaces apart, is taught by Wallin in U.S. Patent No. 5,543,910. In Wallin, the size 
of an object is calculated based on a geometric model with two signals being sent from 
two different periscopes and at two differing angles with respect to the host devices to 
determine the actual distance via the geometric model from the feedback. The Wallin 
1 5 system is capable of location and is not a per se imaging system. 

Cooper, U.S. Patent No. 6,319,079, describes a system with a video camera which 
sends back images from the underwater site. This device is also limited in that it requires 
a diver to operate the equipment. 

Geiger, U.S. Patent No. 5,947,051 also describes a system with a camera attached 
20 to it and discusses 3-D images. Geiger uses a system with a lidar x-y raster scanning 
laser beam instead of a video type of camera to obtain images. Because of the raster 
feature, this differs from a single fixed source. In addition, a TV camera is also disclosed 
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as an alternate embodiment, but there is no discussion of the turbidity problems that 
miderwater optical imaging can experience. 

Patterson et al, U.S. Patent No. 5,995,882, also describes a system with a video 
camera. No discussion is made on how the images are enhanced or obtained in sufficient 
5 clarity to produce accurate representations of the object under investigation. 

The use of fluorescence to detect organic materials is taught in Andrews, U.S. 
Patent No. 5,929,453. In Andrews a spectrometer type of instrument is used to detect 
trace organics for oil spill determination but the system is not part of a moving or 
scanning type of device. 
10 Finally, Schmidt et al, U.S. Patent No. 5,687,137, describes a combination wide- 

scale and smaller scale measurement system which can be programmed to respond to a 
signal instructing it to return to an area of interest and activate finer measurements via 
tomography. This system, although it is sonic in design, is capable of both broad 
scanning and finer types of scans. No imaging specifics are addressed in this patent. 

15 

SUMMARY OF THE INVENTION 
The present invention provides for a 3-D imaging system and method of obtaining 
3-D images adapted for remote information acquisition. An embodiment of the present 
invention comprises a platform for supporting and conveying the imaging system, an 
20 illumination soxirce affixed to the platform which transmits light to a subject surface, a 
light detector affixed to the platform adapted to collect light reflected back fi-om the 
subject surface, and a data processing system in communication with the light detector 
for compiling data obtained fi-om the reflected Hght to produce an image therefi-om. 
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The present invention further provides for detecting the change in wavelength 
associated with Ught received from the subject surface. The illumination source for use 
with the present invention can be any light emitting device. It, however, is preferred in 
this invention to use a laser, and more preferably to use a laser with a planar geometry. 
5 The laser used by this invention can have a wavelength in the range of 400 to 630 nm, 
preferably in the range of 450 to 600 nm, and most preferably in the range of 500 to 575 
nm. 

The present invention can analyze and scan a variety of subject surfaces. For 
example, the present invention can analyze and scan sea floor, objects resting on the sea 
10 floor, tethered objects, ship's hulls, seawalls, and floating objects. 

The present invention can be used with a navigational sensor system in order to 
facilitate locating an object being scanned. 

Still additional objects or embodiments will become apparent as the invention is 
further described. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is an elevation schematic of an embodiment of an imaging system of the 
instant invention. 

FIG. 2 is a more detailed showing of the imaging portion with respect to the 
20 algorithm values used for resuUs calculation of the instant invention. 

FIG. 3 shows another embodiment of the instant invention having a fiher means 
for fluorescent detection. 
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FIG. 4 shows a further embodiment of the instant invention with two cameras 
for simultaneous viewing of a plurality of sides of the subject object. 

FIG, 5 shows a further embodiment of the invention including a beam splitting 
device for channeling the reflected Ught into multiple detector systems. 

5 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The present invention provides for a 3-D imaging system and method of obtaining 
3-D images adapted for remote information acquisition. An embodiment of the present 
invention comprises a platform for supporting and conveying the imaging system, an 

10 illumination source affixed to the platform which transmits light to a subject surface, a 
light detector affixed to the platform adapted to collect light reflected back from the 
subject surface, and a data processing system in commxmication with the light detector 
for compiling data obtained from the reflected light to produce an image therefrom. 

The present invention further provides for detecting the change in wavelength 

15 associated with light received from the subject surface. The illumination source for use 
with the present invention can be any Ught emitting device. It, however, is preferred in 
this invention to use a laser, and more preferably to use a laser with a planar geometry. 
The laser used by this invention can have a wavelength in the range of 400 to 630 nm, 
preferably in the range of 450 to 600 nm, and most preferably in the range of 500 to 575 

20 nm. 

The present invention can analyze and scan a variety of subject surfaces. For 
example, the present invention can analyze and scan sea floor, objects resting on the sea 
floor, tethered objects, ship's hulls, seawalls, and floating objects. The data processing 
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system compiles the data obtained from the reflected light which can be stored for later 
use or transmitted to a remote location in real time for projection of the image on a 
display. 

The present invention can be used with a navigational sensor system in order to 
5 facilitate locating an object being scanned. 

Referring now to FIG. 1, the instant system 10 includes a platform 11 which 
contains an illumination source 12 which is directed to a surface 13, which is in turn 
recorded by virtue of a light detector 14. 

The platform 11 may be of any design for conveying the imaging apparatus, these 
10 including AUV's, ROV's, and other underwater conveying means. In addition, boats or 
ships may be outfitted with the apparatus of the instant invention. The imaging may 
occur below, above, on the surface of a body of water or as a side-scanning function with 
respect to the horizontal axis of the platform. In addition, if aerial observation is intended 
as the use, any form of manned or unmanned vehicle may be used as the supporting and 
15 impelling means. Also contemplated is the use of stationary underwater platforms geared 
to image ships or other water vessels as they pass over it. For the purposes of the 
preferred embodiments of this application, however, ROV's or AUV's are the preferred 
platforms. 

The illumination source 12 may also be any suitable illumination means known to 
20 one of ordinary skill in the art, but for the purposes of the preferred embodiment, is a 
laser source. This source may be selected as a narrow wavelength source as desired for 
the fluorescence embodiment of the instant invention, or may be of a broader range of 
wavelengths for more general illumination. In addition, a single source may be used or a 
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plurality or sources, including use of a multiplicity of different types of illumination 
devices as known to those of ordinary skill in the art. The source or sources are 
preferably movably mounted to provide flexibility in changing the source to detector 
separation as desired. It is considered preferable to use a very high intensity laser source 
5 so that a high degree of illumination is achieved from this source. In addition, various 
filter mechanisms may be used in combination with the light source to screen out or 
isolate certain wavelengths. It is preferred that the source should have a narrow field of 
view in the along-track direction such as provided by a spot or cross-track-dispersed fan 
beam. 

10 The surface or object 13 may be any desired surface for inspection. Some of 

these include, but are not limited to, sea floor, ship's hulls, seawalls, and objects resting 
on the sea floor or tethered to it and floating objects. It is xmderstood for the purposes of 
this application that the term "sea" encompasses any body of water, fresh or salt in nature 
and of any size. In the case of ship's hulls, the instant invention is arranged so that the 

15 illumination is directed to a side-facing surface or even an upwardly facing surface, such 
as the actual bottom of a ship. In addition, in the above in-water embodiments, the 
apparatus may be used to image tops, sides, or bottoms of objects of interest. 

The light detector 14 may comprise any type of known device to those of ordinary 
skill in the art such as still cameras, video cameras, computer digitization, and graphic 

20 representations. In addition, it is contemplated that a plurality of these means may be 
used jointly either solely or in combination to provide information storage and display 
means. The recording or detection device is preferably also movably mounted to allow 
for adjustments in the soxirce-to-detector-separation and the viewing angle of the detector 
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as desired. Both real time imaging and data storage are the recording or detection device 
of choice in certain preferred embodiments. In addition, any known camera enhancement 
systems may be employed, these including filters and focusing means ~ such systems are 
readily known and available to one of ordinary skill in the art. 



invention. Li this embodiment, the illumination source 12 is directed downward toward 
the object 13 with the detector 14. By virtue of their fixed relationship to one another, 
the height and geometric features of the object 13 can be represented both visually by the 
camera and digitally by virtue of the digital image generated by the calculations made by 
10 the equation: 



5 



FIG. 2 is a more detailed representation of the imaging system of the instant 




15 



where: 



totakows = total # of vertical imaging elements or pixels 



20 



row# = current row where Une is detected 



R = the distance between the source and the object being scanned 



25 



S = the distance between the source and the detector 



F.O.V. = the field of view as seen by the detector in relation to the 
object 



30 



(|) = the vertical angle between the illumination beam and the 
center of the field of view of the camera 
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Because the illumination source 12 and recorder or detector 14 are separated and 
not coaxial, backscatter effects from the illumination source due to the presence of 
particulates in the water are reduced. In addition, the calculated digital image offers a 
graphic representation of the image either in combination with the visual image or as a 
5 sole product of the imaging apparatus 10. It will be understood that a total visual image 
is also possible without digitization. Thus, when an illumination beam is fanned out 
across the vehicle path and viewed with a camera, the above equation can be developed 
in 3-dimensions for each point where the fan beam hits a solid object. 

The 3-D image of the subject object is calculated as the distribution of the 

10 progression in the values of R as each sequential line is recorded and assessed according 
to the equation above and the removal or subtraction of the height of the background, 
such as the actual sea floor. Because the emitted light from the illumination source 12 
can be adjusted to be a fine thin line for calculation purposes, the resultant image 
obtained can actually be a compilation of a large plurality of sequential lines calculated 

15 back to the R value with adjustments made for variation in intensity, these being a 
function of both the R value and a compensated value obtained algorithmetically. Due to 
the fact that light within the water milieu is subject to varying amounts of scattering, the 
algorithmic adjustment is necessary to compensate for these scattering effects in the 
aqueous environment. 

20 An additional adjustment can also be made to incorporate navigational and/or 

vehicle speed data into the final positional equation so that a more accurate location is 
assigned to the object. This can be achieved by incorporation of navigational sensors or 
sensor systems which are attuned to respond to GSP, compass, gyro navigational 
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systems, or others such systems as known to those of ordinary skill in the art. In addition, 
compensation for the pitching and rolling of the platform can also be taken into account 
so that the accuracy of the depiction of the image obtained is increased. By use of 
compensation, a more exact location is achieved with respect to a fixed object as well as 
5 the ability to locate objects on a moving surface also being possible. This could enable 
scanning of ship hulls for foreign objects relative to fixed positions along their extent 
while they are underway or drifting. In a fiirther embodiment of the instant invention, as 
depicted in FIG. 3, a fluorescent analysis system or other altemative systems can be used 
either solely or in combination with the primary system. In this embodiment the camera 

10 or other detection means is replaced with a fluorescent detection means. This enables 
analysis of organic material present on the surface of the subject object. This particular 
knowledge is usefiil when a determination is necessary to ascertain the amount of time a 
particular surface has been in the aqueous environment with respect to other surfaces in 
the environment. For example, if an object has been recenfly added to a ship's hull, the 

15 amount of organic material present in that portion of the hull will be less than on the 
surrounding surfaces, and if that object is not otherwise accoxmted for by recent repair 
activities, then its presence may be of a suspicious nature. This type of knowledge is 
very helpfiil when it is desired that ships entering a possible port be fi-ee of possible 
terrorist-connected problems or when a ship may have been in some other way 

20 compromised in its integrity. 

In order to effect the fluorescent embodiment of the instant invention, it is desired 
that the illumination source 12 illuminate at the desired wavelength. As known to those 
of ordinary skill in the art, for example, the use of a green light illumination at 532 nm is 
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absorbed by organic material and fluoresced at 685 nm in the red range. Thus, if a 
scanning system is used where a combination of green and red detectors are reading the 
backscattered light, a change in the concentration of the organic material changes the 
ratio of the green/red returned signals. In this application, as the surface is scanned, if a 
5 new portion has been recently added, then the amount of red given off by that material 
goes to zero and the ratio instantly signals that a surface change is present. 

The illumination means itself may be tuned to a specific wavelength or 
wavelengths, or an appropriate filtering means may be used in concert with the source to 
tune the emitted light. This is also true of the detection or sensor means which may also 

10 have attenuating means connected with it to aid in selection of the desired wavelength. 
Of course, to maximize sensitivity with less costly illumination sources and detectors, it 
is preferable to use filtering means at both the source and detection portions of the 
analytical equipment. This choice as well as the choice of the specific source, detector, 
and filtering means are well within the scope of ordinary skill in the art. 

15 It is further contemplated that the illumination source may also be a pulsed, 

strobe, or other "time-gating" source as known to one of ordinary skill in the art. This 
time-gating enables synchronization of the source with the detection means so that effects 
of outside interference are minimized. By collecting light only during the appropriate 
positive pulses of the time-gates, appropriate speed of light in water, and appropriate 

20 distance to the surface of interest, the effects of ambient light on the system are reduced. 
Motion blur effects can also be reduced in a time-gated system. 

It is also contemplated that a simpler version of the fluorescence system may be 
used without the dual ratio calculating capacity. Thus a green-green system, a red-red 
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system, a green-red system, a red-green system, or even multi-source illumination in the 
blue and green regions are possible with a red receiver/sensor. This would allow 
discrimination of the type of organism involved in bio-fouling which results in 
fluorescence. In addition a broad wavelength system may also be used for material 
5 analysis of the surface, excluding the presence of organic material and instead directed to 
the presence of foreign materials on the surface of the scanning target. It is further 
contemplated that any analytical system based on reflected light known to one of 
ordinary skill in the art may be incorporated into the instant system. These may be used 
for metals, plastics, fibrous materials, or other light detectable materials as desired by one 

10 of ordinary skill in the art. 

In addition to the single illumination source and single camera system of FIGs. 1- 
3, a plurality of sources, cameras and/or detectors and, indeed, the combination of both a 
plurality of detection means and sources is also contemplated by the instant invention. 
The addition of a pluraUty of analysis systems in a multiple sensing system allows for the 

15 simultaneous assessment of a variety of surfaces or for the performance of multiple types 
of analysis at one time. This is particularly helpful when it is desired to scan the entire 
surface of an object without changing the direction of movement of the platform. 

An of embodiment of a multiple sensing system is shown in FIG. 4. Here, a 
single illumination source 12 supplies the light incident on object 13 which is reflected 

20 back to the two cameras 14 and 41 through lenses 42 and 43. It is also contemplated that 
a dual source, single detection system may also be used. By use of this geometry, it is 
possible to examine a plurality of surfaces with the platform moving only once over the 
object's location. This is particularly useful when the object or desired feature for study 
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is then calculated back to a specific position or position on a subject surface. Thus the 
need for a multiplicity of passes over the object is obviated and the inherent problems of 
having to compensate for the new directional parameters are not present. This affords the 
user a simpler method of not only performing the scan, but also allows for analyses to be 
5 made under a wider variety of conditions such as rough water or on free-floating ship's 
surfaces. Because a single set of operating parameters is presented for calculation 
purposes, the resultant system is easier to handle and the data thus obtained are more 
reliable. In addition, by use of a single scan over a multiple direction scan, the optimum 
single direction whether it is chosen due to water conditions or because of its relation to 

10 another feature or surface, may be examined without having to gather performance data 
multiple times with respect to direction. 

In the embodiment depicted in FIG. 5, and additional beam-splitting device 55 is 
inserted into the system. This device serves to physically divide the reflected signal into 
a plurality of equal components which are then conveyed into separate detectors such as 

15 14a and 14b. This device may be a mirror type of device or any other reflective type of 
device available to one of ordinary skill in the art, such as an optical switch. This 
embodiment shows two detectors, but it is considered within the scope of the invention 
that any number of detection means may be chosen as desired by the particular 
application. If desired, each detector may be tuned to a different frequency or 

20 wavelength for simultaneous, multispectral imaging. In this fashion, 3-D and fluorescent 
imaging can occur simultaneously. 

In addition, the location or locations of the cameras or detection means and the 
illumination source or sources may be moved to any desired location along the extent of 
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the platform. This enables the artisan to stabilize the analysis system with respect to the 
movement of the platform and serves to reduce the effects of motion on the camera and 
illumination equipment. Also, by selectively locating the camera with respect to the body 
of the platform, the effects of pitch and yaw in rough conditions can be minimized by 
5 using the platform body as a stabilizer. 

It is also contemplated that a plurality of geometries for the actual target of the 
illumination source 12 may be used. Thus, the system 10 may be configured with respect 
to the platform for scanning not only under the platform as shown in FIG. 1, but also 
configurations for scanning above and sideways with respect to the longitudinal axis of 

10 the platform are contemplated. Indeed, when a plurality of illumination and 
detection/camera systems are used, a plurality of combination of configurations is 
possible. The ability to locate the proper scanning system or systems, and subsequent 
configuration, is considered within the scope of ordinary skill in the art and can be chosen 
for the desired application. 

15 It is also contemplated that additional types of analysis systems may be added to 

the platform in order to vary the type of analyses made by the instant system. Some of 
these include, but are not limited to, sonar systems, fluorescence systems, and other 
sensor based systems which may be used to monitor a variety of additional parameters 
simultaneously as chosen by one of ordinary skill in the art. In addition, when it is 

20 desired, other spectroscopic systems may also be used, including those operating in the 
UV, IR, and visible ranges. 

In order to effect the fluorescent or other spectroscopic embodiments of the 
instant invention, it may be desired that the illumination sowce 12 be tuned to give a 
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desired wavelength. In addition, the detection system may also be tuned to screen out 
undesired backscattered light in order to optimize the readout of the system. Also, any 
combination of tuned and untimed detectors and sources are considered within the scope 
of the instant invention and are a matter of choice as desired for particular applications. 
5 The tuning means may be an optical filter system or other means as known to those of 
skill in the art. Indeed, if a laser source is used, the laser itself may be tuned or, in the 
interest of economy, a separate tuning means may be used in conjunction with the laser. 

As known to those of ordinary skill in the art, as discussed before, the use of a 
green light illumination at 532nm is reflected back at 685nm in the red range due to the 

10 presence of organic material. Thus, if a scaiming system is used where a combination of 
green and red detectors are reading the backscattered light, then if a change in the 
concentration of the organic material changes the ratio of the green/red returned signals. 
In this way, as the surface is scanned, if a new portion has been recently added, then the 
amount of red given off by that material goes to zero and the ratio instantly signals that a 

15 surface change is present. By use of appropriate optical filters and tuning means, the 
source and detectors may be optimized for a specific set of wavelengths. 

Modification and variation can be made to the disclosed embodiments of the 
instant invention without departing from the scope of the invention as described. Those 
skilled in the art will appreciate that the applications of the present invention herein are 

20 varied, and that the invention is described in the preferred embodiment. Accordingly, 
additions and modifications can be made without departing from the principles of the 
invention. Particularly with respect to the claims it should be understood that changes 
may be made without departing from the essence of this invention. In this regard it is 
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intended that such changes would still fall within the scope of the present invention. 
Therefore, this invention is not limited to the particular embodiments disclosed, but is 
intended to cover modifications within the spirit and scope of the present invention as 
defined in the appended claims. 
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